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1.  Objectives. 

The  broad  objective  of  this  research  was  to  provide  robust  and  efficient  iterative  methods 
for  large  scale  systems  of  nonhnear  and  linear  algebraic  equations,  especially  those  arising  from 
discretizations  of  partial  differential  equations,  integral  equations,  and  other  continuous  problems. 
The  methods  of  interest  for  nonlinear  systems  were  mainly  Newton  iterative  (truncated  Newton) 
methods,  i.e.,  implementations  of  Newton’s  method  in  which  an  iterative  linear  solver  is  used  to 
solve  approximately  the  linear  systems  that  characterize  Newton  steps.  Also  of  interest  were  quasi- 
Newton  methods,  in  which  Newton  steps  are  determined  using  an  approximate  Jacobian  maintained 
by  updating.  The  methods  of  interest  for  linear  systems  were  mainly  Krylov  subspace  methods 
for  general  nonsymmetric  linear  systems,  together  with  “residual  smoothing”  techniques  applied  to 
them. 

Specific  research  objectives  for  Newton  iterative  methods  were  to  develop  (1)  theoretically 
sound  and  practically  effective  “globalization”  techniques  (for  enhancing  convergence  from  poor 
initial  guesses)  and  strategies  for  terminating  the  linear  iterations  at  each  Newton  step,  (2)  imple¬ 
mentations  of  iterative  linear  solvers  that  are  particularly  well  suited  for  use  in  Newton  iterative 
methods,  and  (3)  high-level  experimental  software  that  will  provide  a  prototype  for  codes  suit¬ 
able  for  public  distribution.  Concomitant  objectives  for  iterative  linear  solvers  were  (1)  to  develop 
more  efficient  and  robust  implementations  of  the  generalized  minimal  residual  (GMRES)  method 
and  (2)  to  explore  theoretical  and  practical  applications  of  “residual  smoothing”  techniques  to 
short-recurrence  Lanczos-based  methods, 

2.  Summary  of  the  research  effort. 

2.1.  Newton  iterative  methods. 

Newton  iterative  methods  are  currently  used  in  many  important  scientific  apphcations,  includ¬ 
ing  many  with  considerable  industrial  importance,  e.g.,  aircraft  dynamics  modehng  at  Boeing  and 
semiconductor  modeling  at  Bell  Labs.  In  addition  to  their  effectiveness  on  important  problems, 
these  methods  also  offer  a  nonlinear  “framework”  within  which  to  transfer  to  the  nonhnear  setting 
any  advances  in  hnear  system  solving,  e.g.,  new  algorithms  for  nonsymmetric  hnear  systems  or 
algorithms  that  exploit  advanced  machine  architectures.  In  spite  of  their  conceptual  simplicity, 
these  methods  involve  complex  issues,  principally  the  following: 
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1.  How  accurate  should  each  approximate  Newton  step  be,  i.e.,  when  should  the  linear  iterations 
be  stopped?  While  some  accuracy  is  clearly  necessary,  obtaining  more  accuracy  requires  more 
linear  iterations,  which  entails  greater  expense,  and  away  from  a  solution,  there  is  a  point 
beyond  which  it  may  be  unnecessary  and  even  counterproductive. 

2.  How  should  the  method  be  “globalized”?  All  Newton-like  methods  require  “globalization”  pro¬ 
cedures  that  test  steps  for  adequate  progress  and,  if  necessary,  modify  them  to  obtain  steps 
that  provide  it.  The  issue  here  is  how  to  construct  globalizations  that  are  compatible  with  the 
strategy  for  stopping  the  linear  iterations  and  other  algorithmic  features. 

3.  Which  iterative  linear  solver  should  be  used?  This  is  a  very  important  issue  that  has  become 
more  difficult  to  address  with  the  proliferation  of  iterative  linear  solvers  in  the  last  few  years; 
see  §2.2  below.  The  best  choice  may  depend  very  much  on  the  application,  but  there  are 
some  general  considerations  relating  to  compatibility  with  the  globalization  and  the  strategy 
for  stopping  the  linear  iterations. 

It  is  assumed  below  that  the  problem  is  to  find  a  zero  of  a  nonlinear  function  F  :  R"  — *■  R”. 

General,  theoretically  sound  frameworks  for  Newton  iterative  methods  have  been  notably  ab¬ 
sent  from  the  literature,  and  a  preliminary  goal  of  this  research  was  to  develop  such  frameworks. 
The  first  two  issues  outlined  above  can  be  addressed  very  effectively  in  the  more  general  context  of 
an  inexact  Newton  method  [SR5]^,  formulated  as  follows: 

Inexact  Newton  Method  [SR5]: 

Let  xo  be  given. 

For  k  =  0  step  1  until  oo  do: 

Find  some  pk  ^  [0,1)  and  Sk  that  satisfy  the  inexact 
Newton  condition  ||F(xfc)  +  F'(a:fc) s^II  <  'nk\\F{xk)\]. 

Set  Xk-\-i  —  ^k  F 

A  Newton  iterative  method  can  naturally  be  regarded  as  a  special  case  of  an  inexact  Newton 
method:  At  the  kth  step,  one  first  chooses  pk  and  then  applies  the  iterative  hnear  solver  to  the 
Newton  equation  F'{xk)  s  =  -F{xk)  until  the  inexact  Newton  condition  holds.  Note  that  the  issue 
of  when  to  stop  the  linear  iterations  is  now  the  issue  of  choosing  pk- 

In  §2.1.1,  research  relating  to  general  inexact  Newton  methods  is  described;  this  provided 
the  desired  general  frameworks  for  Newton  iterative  methods.  In  §2.1.2,  work  is  outlined  relating 
to  a  Newton  iterative  implementation  of  a  particular  inexact  Newton  method  formulated  in  [PI]. 
Research  on  iterative  linear  solvers  that  relates  to  the  third  issue  above  is  discussed  in  §2.2. 

2.1.1.  Inexact  Newton  methods.  It  is  shown  in  [SR5]  that  the  local  convergence  of  an  inexact 
Newton  method  is  controlled  by  the  choices  of  the  pks,  and  simple  choices  are  outhned  in  [SR5] 
that  result  in  desirable  convergence  rates.  However,  that  paper  does  not  address  either  global 
convergence  or  deeper  issues  associated  with  choices  of  the  pk^- 

Beginning  in  1989,  the  PI  began  a  collaboration  with  S.  Eisenstat  that  resulted  in  inexact 
Newton  methods  with  very  strong  global  convergence  properties.  The  results  are  written  up  in 
[PI],  the  original  version  of  which  appeared  as  a  research  report  in  February,  1991.  During  the 
1991-94  period  of  this  grant,  there  were  significant  revisions  of  [P 1] ,  including  considerable  extension 
of  the  original  results.  This  paper  appeared  in  SIAM  Journal  on  Optimization  in  May,  1994. 

^  Referencing  conventions  are  as  foUows;  Publications  acknowledging  support  from  this  grant  are  referenced  by 
[P.  .  .]  and  listed  in  §3.  Supplementary  references  are  referenced  by  [SR.  .  .]  and  listed  in  §4.  Talks  on  research 
supported  by  this  grant  are  referenced  as  [T.  .  .]  and  listed  in  §6.1. 
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In  follow-up  work  to  [PI],  the  PI  worked  with  Eisenstat  on  the  issue  of  making  refined  choices  of 
the  T/fc’s.  Choices  that  had  previously  been  proposed  result  in  desirably  fast  asymptotic  convergence 
near  a  solution  but  do  not  adequately  address  efficiency  and  robustness  away  from  a  solution.  The 
central  issue  is  that  of  oversolving  the  Newton  equation,  i.e.,  going  to  the  expense  of  reducing 
the  linear  residual  norm,  which  is  also  the  local  linear  model  norm,  beyond  the  point  at  which 
the  local  linear  model  begins  to  depart  significantly  from  the  nonlinear  function.  Several  very 
promising  choices  of  the  rjk's  were  arrived  at  which  mirumize  oversolving  on  a  number  of  realistic 
test  problems  while  retaining  desirably  fast  asymptotic  convergence  near  a  solution.  Furthermore, 
our  testing  indicates  that,  by  maintaining  good  agreement  between  the  nonlinear  function  and  its 
local  linear  models,  these  choices  relieve  the  globalization  of  much  of  its  burden  and  consequently 
enhance  the  robustness  of  the  method.  This  work  is  written  up  in  [P6]. 

2.1.2.  Newton  iterative  backtracking  implementations.  A  general  inexact  Newton  back¬ 
tracking  method  is  formulated  in  [PI]  that,  although  simple,  has  strong  global  convergence  prop¬ 
erties  and  allows  for  choices  of  the  7?fc’s  that  result  in  desirably  fast  asymptotic  convergence  to 
a  solution.  Code  was  developed  for  a  Newton  iterative  implementation  of  this  method  that  uses 
restarted  GMRES  [SRll,  SR15]  as  the  iterative  linear  solver.  GMRES  is  a  natural  first  choice 
for  the  iterative  linear  solver  because  it  is  robust,  generally  apphcable,  and  well  understood;  other 
solvers  wiU  be  implemented  in  future  work.  This  code  was  very  useful  in  experiments  concerning  the 
choices  of  the  r?fc’s  in  the  work  with  Eisenstat  described  above;  these  experiments  in  turn  allowed 
us  to  determine  a  preferred  choice  for  general  use  in  the  code. 

At  present,  the  code  can  be  considered  a  high-level  experimental  code.  This  code  and  its 
performance  on  an  initial  set  of  test  problems  (PDE’s  and  integral  equations)  have  been  described 
in  the  proceedings  of  the  1992  Copper  Mountain  Conference  on  Iterative  Methods  [P3],  and  it  has 
received  mention  in  the  notes  for  a  short  course  on  optimization  software  given  in  conjunction  with 
the  1992  SIAM  Meeting  on  Optimization  in  Chicago  [SR17].  It  is  planned  to  expand  [P3]  into 
a  paper  suitable  for  journal  publication  and  to  further  develop  the  code  into  a  robust,  efficient,  ^ 
portable  code  that  is  suitable  for  public  distribution. 

Consideration  of  extensions  or  alternatives  to  basic  features  of  the  code  has  been  undertaken. 

In  collaboration  with  M.  Pernice  of  the  scientific  staff  of  the  Utah  Supercomputing  Institute  at  the 
University  of  Utah  and  L.  Zhou,  a  postdoctoral  associate  there,  the  PI  has  begun  investigation  of 
globalization  alternatives  to  backtracking  and  has  made  initial  experiments  with  iterative  linear 
solvers  other  than  GMRES.  Also,  jointly  with  Pernice  and  Zhou,  the  PI  has  initiated  research  on 
domain  decomposition-based  parallel  implementations  of  the  code,  with  applications  to  reactive 
flow  modeling  problems.  In  other  applications,  the  PI  has  begun  work  with  M.  Wheeler  and  her 
associates  at  Rice  University  to  adapt  the  code  to  nonhnear  reservoir  engineering  problems  using 
a  domain  decomposition  approach. 

2.2.  Iterative  linear  solvers. 

As  noted  in  §2.1,  a  very  important  issue  in  implementing  a  Newton  iterative  method  is  the 
choice  of  an  iterative  hnear  solver.  Of  course,  iterative  linear  solvers  are  also  of  great  interest  in 
their  own  right.  Accordingly,  considerable  effort  has  been  directed  toward  the  development  and 
understanding  of  iterative  linear  solvers. 

In  recent  years,  there  has  been  a  remarkable  proliferation  of  conjugate  gradient-type  methods 
for  general  nonsymmetric  hnear  systems,  especially  Krylov  subspace  methods.  For  solving  a  system 
Ax  =  6,  these  methods  begin  with  an  initial  a;o  and,  at  the  fcth  iteration,  determine  Xk  =  xo  +  Zk  for 
some  correction  Zk  in  the  fcth  Krylov  subspace  Kk  =  span  {t-q,  Aro, . . . ,  where  ro  =  b-Axo- 

See  [SR8]  for  a  general  discussion  of  these  methods  and  a  description  of  specific  methods  referred 
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to  here.  This  proliferation  shows  no  signs  of  abating  and  offers  both  challenges  and  opportunities. 
During  the  1991-94  period  of  this  grant,  work  centered  around  GMRES  [SRll,  SR15]  and  “residual 
smoothing”  techniques  for  general  iterative  linear  solvers. 

2.2.1.  GMRES  work.  GMRES  is  perhaps  the  most  widely  used  and  best  understood  iterative 
method  for  general  nonsymmetric  linear  systems.  Research  was  directed  toward  developing  more 
robust  and  efficient  implementations  of  GMRES. 

The  PI  collaborated  with  A.  SkjeUum,  P.  Brown,  and  others  in  the  Computing  and  Mathemat¬ 
ics  Research  Division  (CMRD)  at  Lawrence  Livermore  National  Laboratory  (LLNL)  to  develop  a 
number  of  different  GMRES  implementations  based  on  previous  [SR15]  and  current  [P2]  work  of 
the  PL  These  implementations  differ  in  the  amount  and  level  of  BLAS  used  in  them  and  conse¬ 
quently  have  differing  potentials  for  exploiting  different  vector  and  parallel  architectures.  One  of 
them  was  chosen  to  be  the  implementation  of  GMRES  in  the  Multicomputer  Toolbox,  a  parallel 
computing  software  toolbox  developed  by  the  CMRD  group.  Fortran  versions  of  all  of  these  im¬ 
plementations  were  made  publicly  available  by  the  PI  through  Nethb.  This  work  influenced  the 
GMRES  subroutine  used  in  the  GMRES-backtracking  Newton  iterative  code  described  above  in 
§2.1.2. 

The  PI  collaborated  with  with  K.  Turner  [P4]  in  determining  efficient  ways  of  obtaining  high- 
accuracy  solutions  with  GMRES.  A  technique  outlined  in  [P4]  for  efficiently  using  higher-order 
finite-differencing  in  evaluating  products  of  the  form  F'{xk)v  in  GMRES  has  helped  to  eliminate 
inaccuracy  without  loss  of  efficiency  in  the  GMRES-backtracking  Newton  iterative  code  described 
above  in  §2.1.2. 

The  PI  and  L.  Zhou,  then  a  Utah  State  graduate  student,  developed  Gram-Schmidt  and 
Householder  implementations  of  GMRES  that  are  simpler  than  the  standard  implementations. 
The  simplicity  is  achieved  by  starting  the  Arnoldi  basis  generation  process  with  Atq  instead  of  ro 
as  in  the  standard  implementations.  As  a  result,  the  GMRES  least-squares  problem  emerges  in 
upper-triangular  form,  rather  than  upper-Hessenberg  form,  and  so  the  usual  QR  factorization  using 
Givens  rotations  is  unnecessary.  These  results  have  been  written  up  in  [P2],  which  will  appear  as 
an  invited  paper  in  the  Journal  of  Numerical  Linear  Algebra  and  Applications  Special  Issue  on 
Iterative  Methods  and  Preconditioners  for  Nonsymmetric  Linear  Systems. 

The  PI  also  collaborated  with  P.  Brown  of  the  CMRD  at  LLNL  to  investigate  the  performance 
of  GMRES  on  singular  or  ill-conditioned  systems.  This  resulted  in  implementations  of  GMRES 
with  improved  capabilities  for  detecting  and  handling  ill-conditioning  when  it  threatens  to  degrade 
the  performance  of  the  method.  This  work  is  written  up  in  [P7]. 

2.2.2.  Residual  smoothing  techniques.  The  PI  and  L.  Zhou  also  collaborated  on  residual 
smoothing  techniques  for  general  iterative  hnear  solvers.  At  least  two  methods  that  have  recently 
received  considerable  attention,  BCG  [SR6,  SRIO]  and  CGS  [SR13],  have  the  undesirable  property 
of  often  producing  wildly  varying  residual  norms,  in  contrast  to  the  monotone  decreasing  GMRES 
residual  norms.  This  has  motivated  the  development  of  other  methods,  notably  Bi-CGSTAB  [SR14] 
and  QMR  [SR9].  In  recent  work  in  [SR12]  and  [SR16],  it  was  shown  that,  given  a  sequence  of  iterates 
produced  by  any  method,  one  can  easily  generate  an  auxiliary  sequence  with  monotone  decreasing 
residual  norms.  Zhou  independently  rediscovered  this  simple  technique  and  developed  an  equivalent 
formulation  with  much  better  numerical  properties.  He  then  extended  it  to  a  broad  class  of  residual 
smoothing  techniques  and  showed  that  the  QMR  method  is  included  in  this  class.  He  and  the  PI 
then  worked  together  to  refine  these  results  and  carry  out  a  number  of  numerical  experiments.  This 
research  showed  that  residual  smoothing  techniques  are  very  useful  both  as  practical  tools  and  for 
the  theoretical  insights  they  give  into  QMR  and  other  QMR-type  methods  [SR2],  [SR7].  This  work 
is  written  up  in  [P5].  In  other  work  on  residual  smoothing,  the  PI  recently  wrote  an  expository  note 
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[P8]  in  which  residual  smoothing  techniques  are  used  to  extend  results  of  Brown  [SRI]  and  CuUum 
and  Greenbaum  [SR3],  [SR4]  correlating  “peaks”  and  “plateaus”  of  residual  norms  produced  by 
some  well-known  pairs  of  Krylov  subspace  methods. 

2.2.3.  Other  work.  It  was  noted  in  §2.1.2  that  the  PI  has  begun  work  with  M.  Pernice  and  L. 
Zhou  of  the  Utah  Supercomputing  Institute  on  applications  of  Newton  iterative  methods  to  reactive 
flow  problems.  This  work  also  includes  applications  of  GMRES  and  other  iterative  linear  solvers, 
with  and  without  residual  smoothing,  to  appropriate  linearized  test  problems.  The  objectives  are 
to  determine  effective  parallel  implementations  and  preconditioners,  especially  in  conjunction  with 
domain  decomposition  techniques. 
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February,  1994;  submitted  to  SIAM  J.  Matrix  Anal.  Appl. 
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5.  Professional  personnel  associated  with  this  research. 

Only  the  PI  has  received  financial  support  from  this  grant;  however,  other  personnel  have  been 
involved  with  the  research  during  the  1991-94  grant  period  as  collaborators,  as  follows: 

P.  N.  Brown,  CMRD,  LLNL. 

S.  C.  Eisenstat,  Computer  Science  Department,  Yale  University. 

H.  Klie,  Ph.D.  student  under  the  direction  of  M.  Wheeler,  Computational  and  Applied  Math¬ 
ematics  Department,  Rice  University. 

M.  Pernice,  Utah  Supercomputing  Institute. 

C.  San  Soucie,  Ph.D.  student  under  the  direction  of  M.  Wheeler,  Computational  and  Applied 
Mathematics  Department,  Rice  University. 

A.  SkjeUum,  CMRD,  LLNL  (now  with  the  Computer  Science  Department,  Mississippi  State 
University). 

K.  Turner,  Mathematics  and  Statistics  Department,  Utah  State  University. 

K.  Vang,  Ph.D.  student  under  the  direction  of  K.  Turner,  Mathematics  and  Statistics  Depart¬ 
ment,  Utah  State  University. 

M.  Wheeler,  Computational  and  Applied  Mathematics  Department,  Rice  University. 

L.  Zhou,  Ph.D.  student  under  the  direction  of  the  PI  (1993-94  degree).  Mathematics  and  S- 
tatistics  Department,  Utah  State  University,  and  postdoctoral  associate,  Utah  Supercomputing 
Institute  (1995-95). 

6.  Interactions. 

6.1.  Invited  talks. 

Invited  talks  on  research  supported  by  this  grant  during  and  immediately  after  the  1991-94 
period  are  as  follows; 

[Tl]  Inexact  Newton  and  Newton  iterative  methods,  Minisymposium  on  Nonlinear  Equations  and 
Optimization  in  Infinite- Dimensional  Spaces,  ICIAM  91:  Second  International  Conference  on 
Industrial  and  Applied  Mathematics,  Washington,  DC,  July,  1991. 

[T2]  Choosing  the  forcing  terms  in  an  inexact  Newton  method,  Conference  on  Numerical  Optimiza¬ 
tion  Methods  in  Differential  Equations  and  Control,  North  Carohna  State  University,  July, 
1991. 

[T3]  Inexact  Newton  and  Newton  iterative  methods,  Lawrence  Livermore  National  Laboratory, 
August,  1991. 

[T4]  Newton  iterative  methods,  6th  DMAS  Workshop  on  Numerical  Analysis,  Oaxaca,  Mexico, 
January,  1992. 

[T5]  A  GMRES-backtracking  Newton  iterative  method.  Conference  on  Iterative  Methods,  Copper 
Mountain,  Colorado,  April,  1992. 

[T6]  Residual  smoothing  methods  for  iterative  linear  system  solvers,  Lawrence  Livermore  National 
Laboratory,  August,  1992. 

[T7]  Iterative  methods  for  large  scale  linear  and  nonlinear  systems.  Frontiers  Lectures  program 
(three  lectures).  Mathematics  Department,  Texas  A&M  University,  October-November,  1992. 
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[T8]  Inexact  Newton  and  Newton  iterative  methods,  Mathematics  Department,  University  of  Hous¬ 
ton,  November,  1992. 

[T9]  Residual  smoothing  techniques  for  iterative  linear  solvers,  poster  presentation,  DOE/OSC 
Applied  Mathematics  Workshop,  Albuquerque,  New  Mexico,  February,  1993. 

[TIO]  A  GMRES-backtracking  Newton  iterative  method.  Special  Session  on  Numerical  Optimization, 
AMS  879th  Meeting,  KnoxviUe,  Tennessee,  March,  1993. 

[Til]  Newton  iterative  and  inexact  Newton  methods,  International  Meeting  on  Linear/ Nonlinear 
Iterative  Methods  and  Verification  of  Solution,  Matsuyama,  Japan,  July,  1993. 

[T12]  Newton  iterative  methods  for  large-scale  nonlinear  systems,  Sandia  National  Laboratory 
(Albuquerque),  October,  1993. 

[T13]  Newton  iterative  and  inexact  Newton  methods.  Computational  and  Applied  Mathematics 
Department,  Rice  University,  December,  1993. 

[T14]  Choosing  the  forcing  terms  in  an  inexact  Newton  method,  Colorado  Conference  on  Iterative 
Methods,  Breckenridge,  Colorado,  April,  1994. 

[T15]  Krylov  subspace  methods  and  residual  smoothing  techniques,  Center  for  Numerical  Analysis, 
University  of  Texas  at  Austin,  April,  1994. 

[T16]  Residual  smoothing  techniques  for  iterative  methods,  Session  on  Iterative  Solution  of  Linear 
Equations,  Generalized  Conjugate  Gradient  methods.  Preconditioners  and  Beyond,  14th 
IMACS  World  Congress  on  Computation  and  Applied  Mathematics,  Atlanta,  Georgia,  Ju¬ 
ly,  1994. 

[T17]  A  GMRES-backtracking  Newton-iterative  method.  Session  on  Algorithms  and  Applications, 
15th  International  Symposium  on  Mathematical  Programming,  Ann  Arbor,  Michigan,  August, 
1994. 

[T18]  Krylov  subspace  methods  and  residual  smoothing  techniques,  Sandia  National  Laboratory 
(Albuquerque),  August,  1994. 

6.2.  Consultative  and  advisory  functions. 

Several  research  collaborations  were  noted  in  §2  above,  and  these  were  often  associated  with 
more  general  consultative  and  advisory  functions,  particularly  in  the  case  of  collaborations  with 
members  of  the  CRMD  at  LLNL.  The  PI  also  visited  Texas  A&M  University  for  two  weeks  in 
October-November,  1992.  The  first  week  was  spent  giving  three  one-hour  talks  in  the  Frontier- 
s  Lectures  program  in  the  Mathematics  Department  [T7].  The  second  week  was  spent  visiting 
the  Institute  for  Scientific  Computation  and  discussing  iterative  methods  for  linear  and  nonlinear 
problems  in  reservoir  engineering  and  seismic  data  interpretation.  Also,  in  1993-94,  the  PI  spent 
a  sabbatical  visiting  the  Computational  and  Applied  Mathematics  Department  and  the  Center  for 
Research  on  Parallel  Computation  at  Rice  University;  he  began  work  with  M.  Wheeler  and  her 
associates  there. 

Other  notable  interactions  have  been  with  researchers  at  Boeing.  Newton  iterative  methods 
with  GMRES  as  the  iterative  linear  solver  have  been  very  successfully  used  at  Boeing  in  electro¬ 
magnetic,  acoustic,  and  aerodynamic  modeling  codes.  A  particularly  successful  application  has 
been  modeling  transonic  flow  by  solving  the  steady  state  full  potential  equation  for  shock  locations 
and  strengths  on  complex  3D  aircraft  configurations.  During  the  1991-94  grant  period,  the  PI 
exchanged  ideas  and  papers  with  R.  Burkhart  and  D.  P.  Young  on  a  number  of  occasions.  He 
also  invited  Young  to  speak  at  a  special  session  at  the  Copper  Mountain  Conference  on  Iterative 
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Methods  in  April,  1992,  and  invited  Burkhart  to  speak  in  a  Minisymposium  on  Iterative  Methods 
for  Large  Scale  Nonlinear  Systems  at  the  SIAM  National  Meeting  in  Los  Angeles,  July,  1992.  In 
November  and  December  of  1992,  the  PI  had  a  lengthy  exchange  with  L.  Wigton,  then  visiting 
NASA  Langley  Research  Center,  over  matters  relating  to  GMRES.  These  mainly  had  to  do  with 
the  accuracy  of  different  implementations  and  techniques  and  with  the  suitability  of  different  im¬ 
plementations  for  large  scale  applications.  In  the  summer  of  1994,  the  PI  discussed  with  Wigton 
various  matters  having  to  do  with  Newton  iterative  methods,  GMRES,  and  preconditioners. 
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